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Abstract 

Since their introduction in the shape analysis community, 
functional maps have met with considerable success due to 
their ability to compactly represent dense correspondences 
between deformable shapes, with applications ranging from 
shape matching and image segmentation, to exploration of 
large shape collections. Despite the numerous advantages 
of such representation, however, the problem of converting 
a given functional map back to a point-to-point map has 
received a surprisingly limited interest. In this paper we an¬ 
alyze the general problem of point-wise map recovery from 
arbitrary functional maps. In doing so, we rule out many 
of the assumptions required by the currently established ap¬ 
proach - most notably, the limiting requirement of the in¬ 
put shapes being nearly-isometric. We devise an efficient 
recovery process based on a simple probabilistic model. Ex¬ 
periments confirm that this approach achieves remarkable 
accuracy improvements in very challenging cases. 

1 Introduction 

Shape matching is a widely researched topic in computer 
vision and graphics, and a diverse range of techniques that 
tackle the proble m o f correspondence have been proposed 
during the years |26| . Of particular interest is the case in 
which the input shapes are allowed to undergo non-rigid 
deformations, which are typically assumed to be approxi¬ 
mately isometric. Recent advancements in this area include 
the seminal work of Ovsjanikov et al. [17] , who proposed 
modeling functional correspondence between shapes; in this 
view, the focus shifts from studying point-wise mappings 
to the definition of a linear operator (the funetional map) 
relating spaces of functions on the two shapes. The classi¬ 
cal point-wise representation constitutes then a special case 
in which the functional map corresponds delta-functions to 
delta-functions. A major advantage of the functional repre¬ 
sentation lies in the linearity of the operator: the functional 
map admits a matrix representation which can be made com¬ 
pact under a p roper choice of bases for the two functional 
spaces. In the authors advocated the use of the Lapla- 
cian eigenfunctions as the natural basis for smooth functions 
on the respective shapes; with this choice, one is allowed to 
“truncate” the representation by using the first few basis 
functions and still obtain a good approximation to the un¬ 
derlying point-wise correspondence. 

Follow-up work by several authors showed how to ex¬ 
tend the framework to deal with non-isometric deformations 
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Figure I: Given a functional map as input, our method al¬ 
lows to accurately recover and refine the underlying point- 
to-point mapping, even under non-isometric deformations. 
In the first row, color encodes distance to the ground-truth, 
increasing from white to red. The input map and its opti¬ 
mized version are shown in the second row. 


|1I|12|19|21| , partial similarity [^, shape exploration |8|23] 
and image segmentation [27] among others. However, de¬ 
spite the success of these methods, there has been a general 
lack of interest on the inverse problem of accurately reeon- 
strueting a point-wise map from its functional representation 
- a common requirement in many practical applications. 

The established approach, originally proposed in [^, op¬ 
erates by formulating the conversion problem as a nearest- 
neighbor search in the embedded functional space; as we 
show in the following sections the approach works well if the 
functional map is accurate enough, with significant decrease 
in accuracy as the number of basis functions is reduced. The 
resulting point-to-point map can be iteratively refined by fol¬ 
lowing a simple procedure, but this can only be done under 
specific assumptions on the initial functional map. A similar 
refinement technique was recently applied for near-isometric 
partial matching [20] , and in a correspondence-less setting 
for shape retrieval tasks [^. Finally, the point-wise recov¬ 
ery problem was sidestepped in [12] by adopting a soft error 
criterion to evaluate the quality of functional maps without 
converting them to a point-wise counterpart. 
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Contribution. In this paper, we consider the problem of 
accurate point-wise map recovery from a given functional 
map. The key contributions can be summarized as follows: 

• We provide the first rigorous analysis of the point-wise 
map recovery problem. In particular, we show how a 
simple modification to the baseline approach can lead 
to consistent improvements. 

• We introduce a simple probabilistic model for map re¬ 
covery and refinement. Our model does not impose 
any assumption on the input functional map, as well 
as on the specific choice of a functional basis on the two 
shapes. 

• Our method is efficient, and significantly outperforms 
the existing method in both, the nearly-isometric and 
the inter-class settings. 

2 Background 

We model shapes as compact connected two-dimensional 
Riemannian manifolds Ai (possibly with boundary) en¬ 
dowed with the standard measure /r induced by the volume 
form. Let Lp‘{Ai) = {/ : —)■ M | < 00 } de¬ 

note the space of square-integrable functions on A^, and let 
{fi9)M — Xm standard manifold inner prod¬ 
uct. The space features the symmetric Laplace- 

Beltrami operator (or Laplacian) : L^(A^) —)■ L^(A^), 

which provides us with all the tools of Fourier analysis on 
our manifold. In particular, this operator admits an eigen- 
decomposition = —Xicpi for z > I, with eigenvalues 

0 = Ai < A 2 < ... and eigenfunctions {(pi}i>i forming an 
orthonormal basis on L^(A^). 

Drawing an analogy with classical signal processing the¬ 
ory, the eigenfunctions are often referred to as manifold har¬ 
monics^ and the assoc iate d eigenvalues assume the interpre¬ 
tation of frequencies [^. Any function / G then 

admits a Fourier series expansion as 

/(*) = ■ ( 1 ) 

i>l 

Functional correspondence. Let us be given two man¬ 
ifolds At and A/", and let T : At —)■ A/" be a bijective map¬ 
ping between them. Departing f rom the traditional point¬ 
centric setting, Ovsjanikov et al. [17] introduced the notion 
of functional map between two shapes as the linear oper¬ 
ator Tp : L^(At) —)■ L^(A/’), mapping functions on At to 
functions on J\f via the composition 

Tp(f) = foT-r ( 2 ) 

The approach is a natural generalization to classical point- 
wise correspondence, which can be seen as the special case 
in which Tp maps indicator functions to indicator functions. 

Let {(pi}i>i and {'ipi}i>i denote orthonormal bases on 
L^(At) and L^{Af) respectively. The functional correspon¬ 
dence with respect to these bases can be expressed as follows. 


for some function / G L^(At): 

Tp{f) = Tp (j2{f,4>i)M<l^i] =J2'^f,<l^i)MTp(4>i) 

\i>l J i>l 

= X] {niipi), ■ (3) 


Thus, the action of Tp amounts to linearly transforming 
the expansion coefficients of / from basis {(pi}i>i onto ba¬ 
sis {'ipi}i>i. The transformation is encoded in the coeffi¬ 
cients Cjj, providing a representation for Tp as the (possi¬ 
bly infinite) matrix C = (cij)- Seeking a functional corre¬ 
spondence among the two shapes then amounts to solving 
for the unknown C that better preserves certain mapping 
constraints |17| or manifesting regularity at different lev- 
els [T^l^ . 

Basis truncation. A natural choice for a basis on the two 
shapes is given by the eigenfunctions {(pi}i>i, of the 

respective Laplacians (harmonic basis). The basis functions 
are said to be compatible among the two manifolds if the 
equality 'ipi = Acpi oT~^ holds (approximately) for alH > 1, 
which is the case with the manifold harmonics when the 
shapes are related by a near-isometry. If the deformation 
is far from isometric, compatible basis functions can still be 
computed ad-hoc for the two manifolds, based on a minimal 
set of coupling functions {e.g.^ a sparse set of point-to-point 
matches) [n]. In particular, since such basis functions still 
exhibit a natural ordering in the Fourier sense, they are said 
to form a ^liasi-harmonic basis. 

Assuming to have stable and compact (namely, harmonic) 
bases at disposal, in [17] the authors proposed to trun¬ 
cate the series at the first k coefficients, resulting in 
a k X k matrix C approximating the full map in a com¬ 
pact way. The reduced representation greatly simplifies 
correspondence-based tasks {e.g., shape matching); at the 
same time, the truncation has the effect of dow-pass’ filter¬ 
ing, thus producing smooth correspondences. In many ap¬ 
plications, however, it is desirable to reconstruct the point- 
to-point mapping induced by the functional map. Thus, the 
interest shifts to the inverse problem of recovering the bi- 
jection T from its functional representation Tp. 

3 Point-wise map recovery 

Let us now consider the discretized problem and assume 
that Ai and J\f are represented by a triangular mesh with 
n nodes each. Let matrices <I>, T G contain the first k 

basis functions for the two shapes respectively, represented 
as column vectors. Note that, due to truncation, we have 
that = Ifc, but ^<I>^ / In, and similarly for We as¬ 

sume that the bijection T : Ai —)■ A/" is known. For the sake 
of simplicity, we additionally assume that T can be repre¬ 
sented as a permutation matrix P G {0, which means 

that the correspondence originates from two different defor¬ 
mations of the same template. In this case the expression 
for Cij in ^ can be equivalently rewritten as: 

C = (4) 
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where C = (cij) G Note that the matrix C is now a 

rank-A; approximation of Tp. The objective of any process 
converting the functional map back into a point-wise map 
representation, which is the focus of this work, is to recover 
the permutation P from the sole knowledge of C, and T. 


Assumptions. In order to be as general as possible, we do 
not assume the matching process which generated the given 
functional map to be known. Additionally, we do not re¬ 
quire any particular properties from C {e.g.^ orthogonality), 
hence allowing to recover maps between shapes undergoing 
arbitrary deformations. Our only requirement is that the 
matrix representation C is given w.r.t. known bases T. 
These bases, in t urn, may c ome from diverse optimization 
processes such as [H 

Mapping indicator functions. 

The simplest and most direct way 
for reconstructing the bijection T 
from the associated functional map 
Tp consists in mapping indicator 
functions : Ad —>■ {0,1} for 

each point x E A4 via Tp, obtain¬ 
ing the image g = Tp(Sx): cind 
then declaring T{x) G A/" to be the 
point at which g attains the maxi¬ 
mum [17] . Such a method, however, 
suffers from at least two drawbacks. 

First, it requires constructing and 
mapping indicator functions for all shape points, which can 
get easily expensive for large meshes. Second, the low-pass 
filtering due to the basis truncation has a delocalizing effect 
on the maximum of g (see inset figure), negatively affecting 
the quality of the final correspondence. 



The inverse problem of point-to-point map recovery. 

Considering the problem of recovering P from a given C ac¬ 
cording to 0 as a (highly underdetermined) ill-posed in¬ 
verse problem, the natural recovery problem to consider is 

P*=arg min i:)(C, 4''^P3>) + aJ^(P) (5) 
Pe{o,i}"X" 

s.t. P^l = 1, PI = 1, (6) 


for a suitable measure of distance D, a regularization func¬ 
tion to possibly impose some kind of desired smoothness 
of the transformation, and a regularization parameter a de¬ 
termining a trade-off between fidelity and regularity. 

Unfortunately, the minimization of 0 will be extremely 
challenging in general. Consider for instance the case of no 
regularization, = 0, a zero functional map C = 0, and 
the distance measure being the squared Frobenius norm. In 
this case the minimization problem becomes 


min ||^^P<F||p = min IIQPlIo 

p^i=i,pi=i p^i=i,pi=i 


min 

p^i=i, pi=i 


P^Q^QP, 


for the right hand sides denoting vectorized equations with 
Q = <I>"^(8)T being formed by the Kronecker product between 


and For arbitrary Q the above problem is a particular 
reformulation of the quadratic integer programming problem 
(see equation (8) in ^). Since the latter was shown to be 
NP-hard we cannot expect to find exact solutions to the 
above problem with reasonable computational complexity in 
general. Therefore, we turn our attention to approximations 
of 1^. 

Linear assignment problem. Instead of applying gen¬ 
eral greedy methods or relaxation te chniques to 1^, let 
us recall some observations from regarding the gen¬ 
eral structure of 0 : In particular, note that the indicator 
function Sx ■ A4 ^ {0,1} around point x has coefficients 
{(pi{x))i=i^__^k in fhe Laplacian basis. This can be seen by 
observing that the inner product is selecting the col¬ 

umn of <I>^ corresponding to point x. Therefore, the image 
via Tp of all indicator functions centered at points of Ad is 
simply given by C^~^. Recovering the point-to-point map 
could then be solved by finding the correspondence between 
the columns of and the columns of Measuring the 

proximity between these columns in the sense gives rise 
to the linear assignment problem 

min (7) 

Pe{0,l}"Xn 

s.t. P^l = 1, PI = 1. (8) 

Althou gh the problem above admits a polynomial time so¬ 
lution [^, typical values for n (in the order of thousands) 
make computing this solution prohibitively expensive in 
practice. 

Nearest neighbors. The authors of [17] circumvent the 
computational costs of the above approach by proposing a 
nearest-neighbor technique for the recovery of the point-to- 
point correspondence. In the light of our previous analysis 
their idea is to consider the matching of every point, i.e., 
column of C^~^, to its nearest neighbor in separately. 

Mathematically, the nearest-neighbor approach can be 
seen as a relaxation of problem ([^, (|^, in which one seeks 
for the best left-stochastic approximation P, i.e., 

min ||C^^ - (9) 

s.t. P^l = l. (10) 

In other words, in comparison to 0 one omits the con¬ 
straint of PI = 1. The omission allows to minimize the 
problem above by independently solving for columns of P, 
one per query. The drawback of such a separable optimiza¬ 
tion approach, however, is that it may produce one-to-many 
mappings as a result of the recovery process. Moreover, the 
nearest-neighbor approach is an asymmetric method: look¬ 
ing for nearest neighbors from to C^"^, or vice-versa, 
will in general produce different results. 

Balanced nearest neighbors. In order to remove the 
bias, we propose to incorporate additional terms in problem 
0 . namely minimize 

||C<l-'r - + A||P - 

s.t. P,Q e {0,p’^l = l, Q^l = l, (11) 
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# basis functions 

Max 

NN 

Balanced NN 

25 

6.14 

30.99 

33.24 

50 

18.12 

43.51 

45.65 

75 

26.96 

52.54 

55.07 


Table 1: Percentage of exact matches recovered from func¬ 
tional maps of increasing rank. We show average results 
obtained by the three methods on 45 shape pairs from the 
FAUST dataset (intra-class, ~7K vertices). The above com¬ 
parison shows that the proposed balancing further improves 
the performance of the nearest neighbor technique. 

where the minimization is performed w.r.t. both P and Q. 
Note that we incorporated the desired property of P being a 
permutation matrix by a soft constraint, he., by penalizing 
the difference of P to Q^. Also note that the limit of A —)► oo 
leads to a convergence of P to a solution of 0 meeting §. 

Instead of solving the minimization problem for increasing 
values of A exactly, we determine an approximate solution 
by alternating minimization on P and Q. The latter leads 
to each subproblem being a simple nearest neighbor problem 
and guarantees the decrease of the objective functions. 

Table ^illustrates the matching accuracy obtained by our 
symmetrized nearest-neighbor method in comparison to the 
classical nearest-neighbor as well as the indicator mapping 
approaches. As we can see, the symmetrization improves 
the results of the biased nearest-neighbor method by 2-3%. 


A probabilistic model. The analysis we provided above 
puts in evidence two major drawbacks, namely: 1) The lin¬ 
ear assignment approach, the nearest-neighbor search, and 
our bi-directional variant, all rely on the assumption that 
the functional map C given as input aligns well the columns 
of with those of 4^^ in the sense. 2) None of the 
above approaches incorporates regularity assumptions for 
the alignment process, i.e., the regularization term in 
the general inverse problem formulation § was omitted. 

We propose to cast the point-to-point map recovery as 
a probability density estimation problem to obtain both, 
a better measure of proximity than the P distance and 
a tool to impose regularity assumptions on the alignment 
map. Within our model, we interpret the columns of C4>~^ 
as modes of a continuous probability distribution defined 
over (the embedded functional space), while columns of 
constitute the data, ie., a discrete sample drawn from 
the distribution. The task is then to align the modes to the 
data, such that the point-to-point mapping can be recovered 
as the maximum posterior probability. 

As a model for the distribution we consider a Gaussian 
mixture (GMM) with n components, having the columns 
of as centroids in M^. For simplicity, we assume the 

components have uniform weight and equal covariances 
cr^. With this choice, the GMM density function is: 

p(y) =(12) 

where we write y and Xj for z = l,...,n to denote 
the columns of 4^^ and respectively, and define 

p(y|xi;<T2) = 


Now let Rq ^ denote the (unknown) transforma¬ 
tion aligning the centroid locations to the data points, 
according to a set of transformation parameters 6. The 
alignment problem can then be solved by maximizing the 
likelihood, or equivalently by minimizing the negative log- 
likelihood function 

L(6»,(t 2) =-^log U ^p(yj|_R(,(xi);(T2) j . (13) 

j=l \ i=l / 

Note that the argument that minimizes in can be also 
interpreted as the argument that minimizes the Kullback- 
Leibler (KL) divergence between a continuous GMM distri¬ 
bution (represented by C<F~^) and a mixture of Dirac distri¬ 
butions (represented by 4^^). Hence, with our probabilistic 
model we are choosing the distance D(C, T^P^) in Eq. 0 
to be the (pseudo-)distance Dkl(C4>^, 4^^P). 

Given optimal parameters d and cr^, the point-to-point 
correspondence probability between x^ and can fi¬ 
nally be obtained as the posterior probability p(xi|yj) = 

Transformation function. The above probabilistic 
model leaves some freedom for the specific choice of a trans¬ 
formation Rq. a simple example is choosing this transfor¬ 
mation as a simple rotation, parametrized by Q. To be more 
fiexible we instead propose to consider the general transfor¬ 
mation: 

i?v(X) = X + V, (14) 

where parameters V assume the meaning of a displacement 
field, and X = C4>^. With this definition, the overall be¬ 
havior of the transformation can be controlled by regulariz¬ 
ing V. 

Assuming that the given func¬ 
tional map C represents a reason¬ 
ably good matching, the refinement 
procedure should not be allowed to 
perturb the initial alignment signifi¬ 
cantly. Here we adopt the Tikho nov 
regularizer ||rV|p proposed in [l4| 

|28] , where F is a low-pass operator promoting smoothly 
changing velocity vectors, hence coherent motion. In the 
inset we illustrate a smooth velocity field with coherent cor¬ 
respondences (blue) and a mismatch produced by simple 
nearest-neighbors (red). We finally obtain the regularized 
objective: 

L(V,<T2) + A||rv||2, (15) 

where A > 0 is a trade-off parameter between likelihood and 
regularity (set to A = 3 in our experiments). 

General alignment problems like ( |15| ) have been widely re¬ 
searched in computer vis ion, an d several robust algorithms 
exist for these tasks [^[^ |14|[^ . Most of these approaches 
follow an iterative scheme, optimizing w.r.t. {0, cr^} and 
p('Ki\yj) in an alternating fashion until convergence (EM al¬ 
gorithm [^). In our experiments, we used publicly available 
code from [14] , which allows to optimize over smooth dis¬ 
placements as in Eq. GH 

In Figure we illustrate a few iterations of the refinement 
process applied to a pair of nearly-isometric shapes, starting 
from a functional map obtained by the matching algorithm 
described in Section As a visual measure of map quality 
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Iteration 

Figure 2: A few iterations of the minimization process for 
problem §• The curve shows the average geodesic error 
induced by the point-wise correspondence obtained at each 
iteration. We visualize the quality of the init ial and final 
maps by using the visualization technique of In this 

example, the ground-truth map exhibits a similar behavior 
to the one we show at the last iteration. 


we employ the technique described in [16] (using the top 5 
singular vectors), which allows to identify the problematic 
areas induced by a given functional map. The quality of 
a map can be judged by the smoothness of the associated 
plots, with better maps having a more localized behavior. 

The output of the EM algorithm is a set of optimal trans¬ 
formation parameters and a left-stochastic correspondence 
P* G {0, 



Figure 3: Solving problem ( |18| > gives rise to the refined func¬ 
tional map shown on the left, where k = 20. The refined 
map attains a higher percentage of exact matches (reported 
in parentheses) than the initial map. The optimal transfor¬ 
mation (middle) essentially delineates the refinement process 
as a perturbation of the identity. 


For a more general refinement procedure, we drop the or¬ 
thogonality constraint on C and consider the problem 

min ||RC<I>^ -T^P||i+^J^(R), (18) 

RGMfcxfc 


for a regularization functional which could encourage 
RC to correspond to a smooth transformation, or could re¬ 
quire R to be a small perturbation of the identity. While 
for the specific example 


J<^(R) = I ° 
oo 


if (RC)TRC = Ife, 

else. 


4 Point-wise map refinement 

As a general representation for shape correspondences, func¬ 
tional maps can be adopted to compactly encode (via 
Eq. Q) any dense point-to-point map obtained by generic 
matching algorithms. Therefore, one can consider locally 
refining the functional map C with the help of the point-to- 
point map recovered with any of the methods described in 
the previous section. Naturally, one can repeat such a strat¬ 
egy and iterate between updating the point-to-point corre¬ 
spondence and refining the functional map. 

Such an iterative procedure was considered in [^, in 
which the authors proposed to use the classical Iterative 
Closest Point (ICP) algorithm The latter updates P ac¬ 
cording to the nearest-neighbor approach followed by a 
refinement of C via 


problem ( |18| ) coincides with the rigid alignment problem 
arising from the constraint ( |17| >, a less restrictive choice 
for the regularization functional makes the method suit¬ 
able for recovering functional maps for non-isometric shape 
matching problems. 

In our experiments we found that when ( |18| > is combined 
with our proposed regularized probabilistic model for recov¬ 
ering the point-to-point correspondence, it is sufficient to 
simply update R in a least-squares sense: Even without ad¬ 
ditional regularization, R is determined to be a perturbation 
of the identity as illustrated in Figure The fact that C 
is refined in a non-rigid fashion can improve the refinement 
results significantly in comparison to orthogonal updates of 
C as illustrated in 3d in Figure^ 

5 Experimental evaluation 


min IIC^"^ - (16) 

C^C = Ife, (17) 

which is an orthogonal Procrustes problem. Intuitively, this 
can be seen as a rigid alignment in between point sets <I>"^ 
and (see Figure Qb) for an example). The alternating 

minimization w.r.t. C and P is repeated until convergence. 

Although the ICP approach described above allows to 
achieve significant improvement s in terms of map accuracy, 
the orthogonality constraints imposed on the func¬ 

tional correspondence limit its applicability to a specific class 
of transformations, namely the class of volume-preserving 
isometries (see |I7] Theorem 5.1). Therefore, the method 
cannot be applied to refine maps between shapes undergo¬ 
ing arbitrary deformations. 


We compare our iteratively refined probabilistic point-wise 
map recovery method with the iterative refinement proce¬ 
dure of Ovsjanikov et al. [17] (denoted as ICP, see Section^, 
which is to the best of our knowledge the only existing al¬ 
ternative to date. Both algorithms were implemented in 
Matlab/MEX and executed (single-core) on an Intel 17-3770 
3.4CHz CPU with 32CB memory. 

As a measure of err or, w e use the quantitative criterion 
that was introduced in to evaluate the quality of point- 
wise maps. The input quantity in our case is a functional 
map C, which is then converted to its point-wise counterpart 
using the two methods. We plot cumulative curves showing 
the percent of matches which have geodesic error smaller 
than a variable threshold. 

We evaluate the two methods quantitatively on the 
FAUST dataset, and qualitatively on the TOSCA and 
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(a) (b) (c) 


Figure 4: The refinement process of a rank-Zc functional map 
can be seen as the alignment of two point sets in In 

the first row we illustrate the action of different refinement 
methods when k = 3, with the two point sets being plotted 
as red and white point clou ds, (a) Initial map; (b) Solution 
after orthogonal refinement ( |16| >; (c) Solution obtained with 
our approach ( |I8| >. In the second row we show the color- 
coded point-wise matches obtained with each method when 
k = 50. 

KIDS datasets. The three datasets include isometric 
as well as non-isometric shapes; in particular, FAUST and 
KIDS also include point-to-point ground truth matches be¬ 
tween shapes belonging to different classes. 

Comparisons. The functional maps used in the com¬ 
parisons are constructed by solving a least-squares system 
CA = B, where matrices A and B contain the Fourier co¬ 
efficients of indicator functions for corresponding regions on 
the two shapes. The region correspondence is established 
using the ground truth, while the sets of re gions are com¬ 
puted using the consensus technique of [^. This way, we 
simulate a matching process that provides reasonably good 
solutions for further refinement. 

We show comparisons both in the near-isometric and 
inter-class settings. In the former case, we use 45 pairs 
of humans in different poses from the intra-class subset of 
FAUST. All shapes have n = 6890 points, and the func¬ 
tional map is computed with A; = 30 basis functions. Re¬ 
sults are reported in Figure!^ (left), where we also included 
plain nearest-neighbors (NN) as a baseline. From the plot¬ 
ted curves we can see that orthogonal ICP is performing 
slightly better than our method on near-isometric deforma¬ 
tions, since the approach is specifically tailored for this par¬ 
ticular case. However, initializing our method with the out¬ 
put of ICP allows to achieve further 10% improvement on 
average. 

In Figure (right) we show the same curves for the non¬ 
isometric case (inter-class matching). In this case, orthogo¬ 
nal refinement cannot be applied due to the different proper¬ 
ties of the input functional maps, which relate shapes under 
non volume-preserving transformations. Additional qualita¬ 
tive comparisons are shown in Figure 

Rank. In a second set of experiments, we evaluate the 
capability of the different methods to recover point-wise 




Figure 5: Left: Comparisons with nearly-isometric shapes; 
in this case, orthogonal refinement already provides accu¬ 
rate point-to-point recovery, which can be further improved 
by applying our algorithm. Right: Comparisons with non¬ 
isometric shapes. In this case, ICP cannot be applied due 
to the lack of orthogonality in C. 


maps from functional maps of increasing rank. In this set¬ 
ting, we assume the input functional map to be as accurate 
as possible, and for this purpose we construct it explicitly 
as C = T"^P<I>, where P is the ground-truth permutation 
among the vertices of the two shapes. We do so for a pair of 
approximately isometric shapes, so that the respective eigen- 
bases ^ and T are as repeatable as possible, and further or¬ 
thogonal refinement is not needed (indeed, applying ICP in 
this setting actually yielded worse results in our tests). 

The results are shown in Figure As the number k of 
basis functions used on the two shapes (ie., rank of C) 
increases, so does the amount of exact correspondences re¬ 
covered by each method. This is also true for the simple 
indicator mapping approach (Max), since the smoothing ef¬ 
fect due to basis truncation is reduced at increasing values 
of k. 

Our method allows to recover up to 20% more exact 
matches than the nearest-neighbors approach. In particular, 
with k = 100 (a commonly used value in most shape match¬ 
ing pipelines) we are able to perfectly reconstruct 75% of the 
rows/columns of P (a 6890 x 6890 matrix in this example). 

Complexity issues. The time performance of our method 
depends on two factors: the number of shape points n, and 
the size of the functional map k. As we also show in Figurej^ 
typically a few iterations of the EM algorithm are sufficient 
to reach accurate solutions, and in practice we used 5 it¬ 
erations in all our experiments. In the typical case where 
n = 10,000 and k = 50, our method takes on average 1 
min. to converge, while ICP using efficient search structures 
(kd-trees) adds up to ~3 sec. 

It should be noted, however, that while we employed an 
off-the-shelf implementation of the minimization algorithm, 
this code can be easily parallelized and optimized in several 
ways. In particular, a GPU implementation of our method 
remains a practical possibility. 

6 Discussion and conclusions 

In this paper we considered the problem of point-to-point 
map recovery and refinement from its low-rank functional 
counterpart. Despite the growing success of this representa¬ 
tion, the problem has received limited attention to date, and 
no significant steps have been made in this direction since 
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Figure 7: Percentage of exact correspondences (bold curves) 
recovered from ground-truth functional maps of increasing 
rank, among the two shapes shown on the right. We also 
report the percent of correspondences with geodesic error 
smaller than 0.02 (thin curves). 


shape collections (joint refinement). We believe these topics 
to represent exciting directions of future research. 
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Figure 6: Refinement examples in different matching scenar¬ 
ios. In each row we show the source shape (left), followed by 
the map errors produced by ICP (middle) and our method 
(right); the map error is visualized as a heat map encoding 
distance to the ground truth, growing from white to black. 
Note how the two methods perform comparably well in the 
near-isometric case (cat model), but orthogonal refinement 
yields large errors with more general deformations. 

the framework’s conception. We formulated a general varia¬ 
tional recovery approach for the inverse problem of comput¬ 
ing point-to-point correspondences from a given functional 
map. We demonstrated what simplifications can be used 
to arrive at the nearest neighbor approach and showed how 
simply mitigating the asymmetry present in the standard 
conversion procedure can lead to consistent improvements of 
2-3% in accuracy. We then introduced a probabilistic model 
for point-wise map recovery and considered a refinement of 
the functional map that does not rely on the assumption of 
isometric shapes. The experimental results showed that the 
proposed approach yields up to 20% accuracy improvements 
under non-isometric deformations, reaching up to 75% exact 
point-to-point matches under good initializations. 

The main limitation of our probabilistic method lies in 
the fact that - similar to the nearest-neighbors approach 
- the optimization procedure is biased towards one of the 
two shapes, as one can for instance see from the interpre¬ 
tation of minimizing the (non-symmetric) Kullback-Leibler 
divergence. Extending the ideas of the symmetrized nearest- 
neighbor approach to the probabilistic model for removing 
this bias represents a possibility. Second, while for simplicity 
we only considered pairs of shapes related by a bijection, our 
method can be modified to deal with shapes having differ¬ 
ent resolutions, as well as partially similar shapes and entire 
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